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DETAILED ACTION 
Response to Amendment 

1 . This action is in response to the communication filed on August 8, 2007. 

2. Claims 1-28 are pending in this action. 

3. The applicant's arguments with respect to claims 1-28 have been fully 
considered but they are not deemed to be persuasive. For examiner's response to the 
applicant's arguments or comments, see the detailed discussion in the Response to the 
Arguments section. 

Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

2. Claims 1-28 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Balabanovic (US 6,624,826). 

As per claim 1 , Balabanovic teaches, "a speech transcription tool comprising": 
"control logic configured to play back portions of an audio stream" (col. 5, lines 

58-64, "buttons for audio control . . . Play"); 

"an input device configured to receive text from a user defining a transcription of 

the portions of the audio stream and receive annotation information from the user 
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further defining the text" (col. 9, lines 23-37, Fig. 4A, claimed "portions of the audio 
stream" is "audio gauges 410 and 420"; claimed "defining a transcription" is "412 
represents a word processing document shown in reduces size . . .icon 426 represents . 
. . similar word processing document" claimed "annotation information" is "XML 
representation references the various electronic documents and audio clips by the way 
of URL address"); and 

"a graphical user interface including a first section configured to display a 
graphical representation of a waveform corresponding to the audio stream, and a 
second section configured to display the text and representations of the annotation 
information for the text" (Fig. 4B). 

As per claim 2, Balabanovic teaches, "a third section configured to display a 
hierarchically structured representation of the text" (Fig. 4B). 

As per claim 3, Balabanovic teaches, "wherein the first section of the graphical 
user interface further includes graphical markers that define the portions of the audio 
stream" (col. 6, lines 4-20). 

As per claim 4, Balabanovic teaches, "wherein the representations of the 
annotation information include graphical icons" (col. 8, lines 33-55). 

As per claim 5, Balabanovic teaches, "wherein the input device further receives 
information from the user classifying the portions of the audio stream into a plurality of 
hierarchical segments"(col. 9, lines 38-52). 

As per claim 6, Balabanovic teaches, "wherein the segments include speaker 
turns, sections, and episodes" (col. 10, lines 51 to col. 11, line 23). 
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As per claim 7, Balabanovic teaches, "wherein the control logic writes the 
transcription of the portions of the audio stream and the annotation information as a 
Unicode output file" (col. 10, lines 59-67). 

As per claim 8, Balabanovic teaches, "wherein the annotation information is 
selected from a possible set of annotation information defined by a configuration file" 
(col. 10, lines 33-50). 

As per claim 9, Balabanovic teaches, "wherein the annotation information is 
entered by the user through predefined keyboard shortcuts" (col. 4, lines 41-51). 

As per claims 10-28, they are interpreted and thus rejected for the same reasons 
set forth in the rejection of claims 1-9. 

Response to Arguments 
3. The applicant argues, "the disclosure of Balabanovic is generally unrelated to a 
speech transcription tool, and certainly does not disclose or suggest, as is recited in 
claim 1 , an input device configured to receive text from a user defining a transcription of 
the portions of the audio stream and receive annotation information from the user 
further defining the text. Allowing a user to record an audio narration that corresponds to « 
a document, as described by Balabanovic, is not reasonably related to an input device 
configured to receive text from a user defining a transcription of portions of an audio 
stream, as recited in claim 1. Further, Balabanovic also does not disclose or suggest 
receiving annotation information from the user further defining the text, as is also recited 
in claim 1. 
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The examiner respectfully disagrees with applicant's above assertion because 
Balabanovic teaches all the claimed limitations, as described in the rejection. The 
claimed "defining a transcription" is "412 represents a word processing document shown 
in reduces size . . .icon 426 represents . . . similar word processing document" : claimed 
"portions of the audio stream" is "audio gauges 410 and 420"; claimed "annotation 
information" is "XML representation references the various electronic documents and 
audio clips by the way of URL address". 

4. The applicant further argues, "in rejecting claim 2, the Examiner points to Fig. 4B 
of Balabanovic. (Office Action, page 3.) Neither Fig. 4B of Balabanovic nor the 
corresponding description in Balabanovic in any way relate to display of a hierarchically 
structured representation of text. In fact, Balabanovic never even mentions the term 
"hierarchical," much less displaying text in the manner recited in claim 2. For this reason 
also, the rejection of claim 2 is improper and should be withdrawn". 

The examiner respectfully disagrees with the applicant's above argument. Here 
in figure 4B, and col. 9, lines 34-41 , Balabanovic teaches, "audio gauge 410 is shown 
graphically connected to electronic document 412 by reference marks 414 . whereas 
audio gage 420 is shown graphically connected to icon 426 by reference mark 424. 
additionally, audio gauges 410 and 420 are shown connected together by connector 
415 which indicates that the two audio clips represented by audio gauges 410 and 420 
are chronically adjacent ", is equivalent to claimed "hierarchically structured". 
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5. The applicant argues that Balabanovic no way disclose an input device that 
receives information from a user classifying portions of an audio stream into a plurality 
of hierarchical segments, as recited in claim 5. 

The examiner respectfully disagrees because the limitation can be reads on 
"audio gauges 410 and 420 are shown connected together by connector 415 which 
indicates that the two audio clips represented by audio gauges 410 and 420 are 
chronically adjacent ". 

6. The applicant further argues, "Balabanovic certainly does not disclose or 
suggest, as recited in claim 6, that the segments include speaker turns, sections, and 
episodes. For this reason also, the rejection of claim 6 is improper and should be 
withdrawn". 

The examine disagrees with applicant's assertion because Balabanovic teaches 
claim 6, limitation at col. 1 0, lines 51 to col. 1 1 , line 23. Here names of the 
corresponding message originators are indicated and a face of the originator can be 
added. 

Response to arguments regarding claims 10-28 are same as above responses. 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
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TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Contact Information 
8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Abul K. Azad whose telephone number is (571) 272- 
7599. If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Patric Edouard, can be reached at (571) 272-7603. 
Any response to this action should be mailed to: 

Commissioner for Patents 

P.O. Box 1450 

Alexandria, VA 22313-1450 
Or faxed to: (571) 273-8300. 

Hand-delivered responses should be brought to 401 Dulany Street, Alexandria, 
VA-22314 (Customer Service Window). 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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